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Abstract 

We present a new algorithm for computing a truncated Markov basis of a lattice. In general, 
this new algorithm is faster than existing methods. We then extend this new algorithm so that 
it solves the linear integer feasibility problem with promising results for equality knapsack 
problems. We also present a novel Grobner basis approach to solve a particular integer linear 
program as opposed to previous Grobner basis methods that effectively solved many different 
integer linear programs simultaneously. Initial results indicate that this optimisation algorithm 
performs better than previous Grobner basis methods. 



1 Introduction 

Consider the set TcW) :— {x G N" : x = v (mod £)} which we call a fiber of the lattice C where 
cgZ" and £ is a sub-lattice of Z n . Importantly, the set of feasible solutions to any integer linear 
program can be equivalently represented in the form Tciv 1 ) for some lattice C and some v 1 6 Z n , 
and conversely, any fiber Tciv') can be equivalently represented as the set of feasible solutions to 
an integer linear program (see Appendix A). We use the lattice notation of Tciv) m this paper 
since we find it notationally more convenient. 

Informally, a Markov basis of the fiber Tciy) is a finite set of vectors in L such that we can move 
from any feasible solution to any other feasible solution in a finite number of steps via other feasible 
solutions using the vectors in the Markov basis. We can step from one feasible solution to another 
by adding or subtracting a vector in the Markov basis. A Markov basis of the lattice £ is a finite 
set of vectors that is simultaneously a Markov basis for every possible fiber Tciv) as v varies over 
Z n . Every lattice has a finite Markov basis, and so, every fiber has a finite Markov basis. 

One of the applications of Markov bases is in algebraic statistics to test validity of statistical models 
via sampling (see Diaconis and Sturmfels [7]). Another area of application is in computational 
biology for problems arising from phylogenetic trees (see [8]). Markov bases are also needed to 
perform integer optimisation using Grobner basis methods. More and more problems are being 
solved with the growing computational power of computer programs such as 4ti2, an open source 
software package for algebraic, geometric, and combinatorial problems on linear spaces ([!]). 
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In some special situations, finding a Markov basis is straight-forward (see [18]), but in general, 
this is not the case. There are three main methods for computing a Markov basis of a lattice, 
(also called a generating set of a lattice): the algorithm of Hosten and Sturmfels in [13] called 
the "Saturation" algorithm; the algorithm of Bigatti, LaScala, and Robbiano in [3] that we call 
the "Lift-and-Project" algorithm, and the algorithm of Hemmecke and Malkin in [12] called the 
"Project-and-Lift" algorithm. Computationally, the Project-and-Lift algorithm is in general the 
fastest of the three algorithms ([12]). 

The above algorithms compute a Markov basis for all fibers of a lattice, but we may only need 
a Markov basis for one fiber; furthermore, there may be a huge difference between the size of a 
minimal Markov basis of a lattice and the size of a minimal Markov basis of a fiber. This makes 
it computationally worthwhile to focus on computing a Markov basis for one fiber. A truncated 
Markov basis with respect to the fiber Tciy) is a Markov basis of a lattice (all fibers) after removing 
all vectors that cannot be used to step between two feasible solutions in the fiber; in other words, 
we remove vectors u G C when there do not exist x, y G Tc{y) such that x — y = u. A vector that 
cannot step between two feasible solutions in the fiber is never needed in the Markov basis of a 
fiber, and thus, a truncated Markov basis is thus a Markov basis of the fiber Tc,(y) but not every 
fiber. A vector that can step between two feasible solutions in Tc(y) still may not be necessary in a 
Markov basis of Tc(y), but hopefully, there are not too many unnecessary vectors in the truncated 
Markov basis. 

The new algorithm for computing truncated Markov bases presented in this paper in Section 5 is 
based upon the Project-and-Lift algorithm combined with a truncated Grobner basis algorithm 
(see [18]), which is described in Section 4. Previously, there were two known methods. The first 
straight-forward method computes a Markov basis of a lattice and then truncates the Markov basis. 
The second method computes a truncated Graver basis of the lattice ([11]), which is a superset of 
a truncated Grobner basis; however, a truncated Graver basis might be a lot larger than a minimal 
truncated Markov basis. The new method is in general much faster than these two methods. 

In Section 6, we present a new algorithm to compute a feasible solution of a fiber Tc(y) (i.e. find a 
point x G TcXy) if one exists) by using an extension of the truncated Markov basis algorithm. At 
the same time as finding a Markov basis, the truncated Markov basis algorithm can also compute 
a feasible solution without much additional computation. The notions of Markov bases and feasi- 
bility are indeed strongly related. Recall that finding a feasible solution of a fiber is equivalent to 
finding a feasible solution of a linear integer program. Feasible solutions are not only interesting 
in themselves, but are also needed to perform integer programming optimisation using a Grobner 
basis (see below) . We also show how to compute a feasible solution of a finite set of different fibers 
TcSy) simultaneously. This is also extended to the truncated case where we focus on one particu- 
lar fiber. We present the promising results of applying the algorithm to solve equality constrained 
integer knapsacks ([2]). 

In Section 7, we solve linear integer programs using Grobner bases, which in this context are 
also known as test sets for integer linear programs. Test sets were first introduced by Graver in 
[10] (see for example [22]). A Grobner basis of a fiber Tc,{y) with respect to some term order y 
is a finite set of vectors in C such that we can improve every non > — minimal point x G Tciy) 
by subtracting a vector in the Grobner basis. A Grobner basis is thus a set of augmenting or 
improving vectors. So, using a > — Grobner basis, given some initial feasible solution of the fiber 
Tciy), we can find the > — minimal point in the fiber Tc{y) by iteratively improving the feasible 
solution until we can no longer do so, in which case, we must have a ^-minimal solution. We 
call the problem of finding the >-- minimal point in a fiber a lattice program; that is, the problem 
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IPc,y(v) := min^{x : x £ Tc{v)}. A Grobner basis of a lattice is a finite set of vectors in C that 
is simultaneously a Grobner basis for every fiber Tc(y) as v varies over Z™. Any integer linear 
program can be expressed as a lattice program and conversely any lattice program may be written 
as a integer linear program, and thus, the concepts of integer linear programs and lattice programs 
are equivalent (see Appendix A). 

The first Grobner basis methods for solving a linear integer program constructed Grobner bases 
of lattices and thus effectively solved the program for all fibers simultaneously ([5]). This makes 
the approach appealing if we wish to solve the program for many different fibers; however, if we 
wish to solve the program for only one fiber then this is a disadvantage because we often do much 
more work than necessary. By using the structure of a fiber, the new algorithm presented here 
focuses on solving the program for a specific fiber. To achieve this, the algorithm does two things: 
it solves a hierarchy of group relaxations to avoid computing with unnecessary constraints and 
it also applies truncation methods which are strengthened by using the cost function. Solving a 
hierarchy of group relaxations was explored in [9, 23, 20, 17], and truncated methods were explored 
in [18]; however, combining these two approaches and strengthening truncation by using the cost 
function has not been done before. 

Grobner bases and Markov bases have corresponding concepts in computational algebraic geometry 
(see [5]) although we do not present it here. Instead, the approach in this paper follows the geometric 
approach in [12, 18, 19, 21, 22]. 

All computations in the paper were done using 4ti2 version 1.3 on a Intel Pcntium4 3.0GHz 
machine running Linux. All timings given are rounded to the nearest one hundredth of a second. 

2 Truncated Markov Bases 

In this section, we define Markov bases of fibers, Markov bases of lattices, and Markov bases of 
Grobner bases. This notion of truncation has been explored in [21] and [18], but only for computing 
truncated Grobner bases, and we apply it here to Markov bases. 

A lattice is a set C C Z" where C = Z(S) = {£j=i A^ : A £ Z k } for some finite set S = 
{s 1 , . . . , s k } C Z™. If £ = Z(5), then we say that S spans C, and if S is inclusion- minimal, then 
we call S a basis of C. 

Given a lattice £CZ", and a vector v £ Z™, wc define the set 

Tciy) ■= {x £ N" : x = v (mod £)} = {x £ N" : x - v £ £} 
that we call a fiber of the lattice C. 

Given a lattice C C Z", a vector ceZ", and a set S C C, wc define the fiber graph Qc{v, S) to be 
the undirected graph with nodes Tc(y) and edges (x, y) if x — y £ S or y — x £ S for x, y £ Tc{y). 

Definition 2.1. Given v £ 7LI 1 , we call a set S C C a Markov basis of Tc(y) if the graph 
Qc [y, S) is connected. The set S is called a Markov basis of C if it is a Markov basis of Tc iy) 
for every v £ Z". 

We remind the reader that connectedness of Qc(y, S) simply states that between each pair x, y £ 
Tc(y) there exists a path from x to y in the graph Gc(v, S). 
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Example 2.2. Let S :={(1,-1,-1,-3,1,2), (1,0,2,-2,-1,1)}, and let C C Z 6 be the lattice spanned 
by S. By definition, S is a spanning set of C, but S is not a Markov basis of C. Observe that 
C = C A := {u : Au = 0, u G Z™} where 



A=(A,I), A 



So, for every v G Z 6 , T c {v) = F A (b) = {(x, s) : Ax + Is = b,x G N 2 , s G N 4 } where b = Av G Z 4 . 
Hence, the projection of Tc(y) onto the (xi, x 2 )-plane is the set of integer points in the polyhedron 
{x G M™ : Ax < b}, and the s variables are the slack variables. Consider v := (2, 2, 4, 2, 5, 1); then, 
Fc{ v ) — Fa{o) where b = Av =(-6,4,11,1) (see Figure la). 
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Figure 1: The set Tc(y) and the graphs Qc{y, S) and t/£(^, S") projected onto the (xi, X2)-plane. 

The graph Qc{v, S) is not connected because the point (3, 4, 12, 2, 0, 0) G Tc(y) is disconnected (see 
Figure lb). Let S' := 5U{(1, 1,5,-1,-3,0)}. The graph of ' Qc{v, S') is now connected (see Figure lc). 
Thus, S' is a Markov basis of Tc(v). 

A truncated Markov basis is a special type of Markov basis of Tciy) for some v G Z n that is 
not necessarily a Markov basis of all fibers. Essentially, a truncated Markov basis with respect to 
the fiber Tc(y) is a Markov basis of £ after removing all vectors u G C for which there does not 
exist x, y G Fc.{y) such that x — y = u. We call the act of removing such vectors truncation. More 
formally, let G be a Markov basis of £; then, the set S := {u G G : u = x — y for some x, y G ^(f)} 
is a truncated Markov basis. Any vector u G C for which there does not exist x,y G Tc(y) such 
that w = x — y can never be an edge in a fiber graph. Hence, we never need such a vector u in a 
Markov basis of Tc(y). Therefore, S must be a Markov basis of the fiber Tc(y). 

The set S above is also a Markov basis of other related fibers. Let v' G Z n where Fc(v') ^ and 
.Fc(z/ — v') 0. The set S is also a Markov basis of the fiber Fc(v'). Let u G £ for which there 
exists x,y E FcW) such that u = x — y, and let 7 G Tc(y — v'). Then, x + 7, y + 7 G Tc{y), and 
moreover, u = (x + 7) — (y + 7); thus, u would not be removed during truncation. So, any vector 
needed in a Markov basis of the fiber Tc{v') would not be removed by truncation, and therefore, 
S is still a Markov basis of Fc{ v ')- The set S is thus a Markov basis of the following set of fibers: 

BcW) := W G Z n : ^c(i/) 7^ and ^ £ (^ - u') ^ 0}. 

This property of a truncated Markov basis is the defining property of truncated Markov bases. 
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Definition 2.3. Given v G Z™, we call a set S C £ a v-truncated Markov basis of C if G is 

a Markov basis of Tc(v') for every v' G Bc{v). 

Note that if TcSy) ^ 0, then v G Bc(y) since ^Fc(0) ^ 0. Therefore, a ^-truncated Markov basis is 
by definition a Markov basis of J-c{v), but a Markov basis of T c(y) is not necessarily a ^-truncated 
Markov basis. Moreover, a ^-truncated Markov basis of C is not necessarily a Markov basis of C. 
In the special case where Tciy) = 0, we have Bc{v) = 0, which is consistent since by definition an 
empty set is a Markov basis of Fc{v) if Tc{y) = 0- 

Additionally, given a vector u G £, there exists x,y G Tciy) where x — y = u if and only if 
Tc(y — u + ) ^ since x — y = u means that x = 7 + u + and y = 7 + u~ for some 7 G N n in which 
case 7 G .7\c(f — u + ) ^ 0. Here, u + G N™ is the positive part of u and u~ G N n is the negative 
part, or in other words, uj~ = max{0,iti} and u~ = max{0, — Ui} for all i = 1, ...,n. Moreover, 
since u + G ^c(m + ) 7^ 0, we have that there exists x,y G Tc(y) where x — y = u if and only if 
u + G 

The set Bc(y) has some interesting properties. Given a set S* C £, the connectivity of the graph 
Qc(y' ', S) for the fibers in Bc{v) is strongly related to the connectivity of Gc{v, S). Note that for 
v' G Bciy), we have 7 + Tciy') C Tc,(y) for every 7 G — f') where 7 + Tc,(y') — {7 + a; : 

x G 7 r £(^')}. So, given 5 C £, any path (x°, x fe ) in Gc{v',S) can be translated by 7 to a 
path (x° + 7, ...,x k + 7) in ^(f, S) for every 7 G Tc{y — v'). Hence, if S is a Markov basis of 
Fc{ v ')i then any two points in 7 + Tc{v') C Tc(y) are connected in Qciy, S). Moreover, we have 
Tt{v')+T c (v-v') C where ^ £ (z/')+J r £(^-^') = {^+y : x G Tc{v'),y£ Tc{v-v')}. Note 

that v — v' E Bc{v) when 1/ G Bc{v). If 5 is both a Markov basis of Tciy') and a Markov basis of 
Tciy — z/), then any two points in Tciy') + Tciy — v 1 ) are connected in Qciy, S). This is shown as 
follows. Any two points in Tc (y r ) + iy ~ v ') can be written in the form x 1 + y 1 and x 2 + y 2 where 

- 'r . >, , , , j \ \ , IV,,!,, ,iw,,-,, iii/^ m lint l !-yi x 2 -\- y^ E y^ -\- J~c{y r } 

Tciy — v') are connected in 



x 1 , x 2 G J-c{v') and y 1 , y 2 G Jx(v — 1/). Now, from above, the points x 1 - 
are connected in Gc( v ,S) and the points x 2 



1 9 

y , x 



y 2 G x 2 



Qc{ v i S); hence, the points x 1 + y 1 and x 2 + y 2 are connected in Gc{v, S) as required. 

Example 2.4. Consider again the set S' := {(1,-1,-1,-3,1,2), (1,0, 2,-2,-1,1), (1,1,5,-1,-3,0)} and 
the lattice C from above. We saw previously that S' is a Markov basis of Tc(y) where v = 
(2,2,4,2,5,1); however, S' is not a v-truncated Markov basis of C Consider v' = (2,2,4,2,0,0) 
(see Figure 2a). Note that v' G B c {v) since v - v' = (0,0,0,0,5, 1) G T c (v - v') ^ 0. 
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Figure 2: The sets Tc{v'), Tc(v"), and Tc(y — v") projected onto the (xi,X2)-plane. 

The graph Qciy' ', S') is disconnected since there are only two feasible points in Tc{v') = {(2, 1, 1, 1, 2, 1), 
(2,2,4,2,0,0)}. The vector (0,1,3,1,-2,-1) gives the unique minimal Markov basis of Tc(y'), and 
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hence, it must be in a v-truncated Markov basis of C The set S" = S"U(0, 1,3, 1,-2,-1) is a v- 
truncated Markov basis of C. 

Although S" is a v-truncated Markov basis of C, it is not a Markov basis for every v" G Z". 
Consider v" =(0,1,0,5,0,0). The graph Gc(v",S") is disconnected since there are only two feasible 
points in T c (v") = {(2,0,1,0,0,3), (0, 1,0,5,0,0)} (see Figure 2b). Observe that v" ^ B c (v) since 
Fc{v - v") = (see Figure 2c). 

In some situations, the ^-truncated Markov basis of C may be empty: a minimal ^-truncated 
Markov basis is empty if and only if \Tc{v)\ < 1 since then the fiber has zero or one elements. On 
the other hand, a minimal ^-truncated Markov basis of C may also be a Markov basis of C. So, the 
degree to which truncation affects the size of the Markov basis varies between the two extremes of 
an empty set and a Markov basis of a lattice. 

3 Truncated Grobner bases 

In this section, we define Grobner bases of fibers, Grobner bases of lattices, and truncated Grobner 
bases (see [21, 18]). 

First, we need to define term orders. We call >~ a term ordering for £ if 

(i) . >- is a total ordering on the set Tc(y) for every v e Z", 

(ii) . there is a unique ^-minimal solution of Tc{y) for every i/£Z" for which Tc{v) ^ 0, and 

(iii) . >- is an additive ordering meaning that for all v G Z" and for all x, y G Fciv), if x >- y, then 

x + 7 >- y + 7 for every 7 e N™ (note that x + 7, y + 7 G Tc(y + 7)). 

The most common term orders are the lexicographic term ordering and the degree reverse lexico- 
graphic term ordering (see for example [6]). 

Definition 3.1. Given v 6 Z" and a term order >~ , we call G C C a >~-Gr6bner basis of Tc(y) 
if for every x G Tc(y), either x is the unique ^-minimal element of Tciy) or there exists a vector 
u G G such that x — u G Tc(y) and x >- x — u. The set G is called a ^-Grobner basis of C if it is 
a Grobner basis for every fgZ™ 

Analogously to truncated Markov bases, we define truncated Grobner bases. 

Definition 3.2. Given v G Z n , we call a set G C C a ^-truncated ^-Grobner basis of £ if G 

is a Grobner basis of Tc{y') for every v' G Bc(y). 

As in the Markov basis case, a ^-truncated ^-Grobner basis is by definition a ^-Grobner basis 
of Tc(y), but a ^-Grobner basis of Tc{v) is not necessarily a ^-truncated ^-Grobner basis and 
furthermore, a ^-truncated ^-Grobner basis of C is not necessarily a ^-Grobner basis of C. 

We can solve lattice programs using Grobner bases. Given a lattice £, a vector v, and a term order 
>-, the problem 

IPc,^{v) ■= min{x : x G Fcty)} 
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is called a lattice program. Given some initial feasible solution x G J r c{ v )i we can solve the lattice 
program IPc^(v) using a Grobner basis G of the fiber Tc{v) by iteratively improving the feasible 
solution using vectors in G. This process constructs a ^-decreasing path in the graph Qc(y,G) 
from the initial feasible solution x to the unique ^-minimal solution where a path (x°, . . . ,x k ) in 
Qc{ v i G) is ^-decreasing if x l >~ x t+1 for i = 0, . . . , k — 1. This gives us an equivalent way of 
defining Grobner bases in terms of paths in the graph Qc{v 1 G) in Lemma 3.3 below. Firstly, note 
that for a vector u G C, where x,x — u G ^ciy) and x >~ x — u 1 we must have u + y u~ . This 
property follows since >~ is an additive ordering. Thus, we only need consider vectors in the set 
Cy := {u e C : u + y u~}. 

Lemma 3.3. Given v G Z™, G C C y is a ^-Grobner basis of Tc(y) if and only if for every 
x G Tc(v) there exists a decreasing path in Qc{ v iG) from x to the unique >- -minimal element in 
Tc{v). 

Importantly, if G C C y is a ^-Grobner basis, then G is a Markov basis of C since given x, y G 
Qc{ v i G) for some veZ", there exists a ^-decreasing path from x to the unique ^-minimal element 
in Tc(y) and from y to the same element, and thus, x and y are connected in Qc{v 1 G). 

We can use Grobner bases to solve the integer program 

IPc,c{v) '■= min{cx : x G Tc{v)} 

given a lattice C, a vector i/£Z™, and a cost vector ceZ". To solve IPc,c{v), we solve instead a 
lattice program IPc^(v) for some term order >~ that is compatible with c. 

Given a vector c G Z", we say that a vector a term order >- is compatible with c if the optimal 
solution of IPc.y(v) is also an optimal solution of IPc,c(y) for all v G Z™ where Ttiy) ^ 0. We 
can easily construct a c compatible order ^ c given some (tie-breaking) term ordering >- as follows: 
x > c y if cx > cy, or cx = cy and x >- y. We must be a little careful here though since >~ c is not 
necessarily a term order. The ordering y c satisfies conditions (i) and (iii) for being a term order, 
but condition (ii) is not always satisfied. The ordering y c is a term ordering if and only if IPc.c(v) 
has an optimal solution for every v G Z™ where Tciy) i= 0- Note that IPc, c {v) has an optimal 
solution for every v G Z™ where J-c(y) ^ if and only if IPc. c (0) '■= min{cx : x E C, x <E N™} = 0, 
and we can check whether IPc,c(0) = using linear programming. 

Conversely, given any term order >- there always exists a compatible c G Z™ such that IPc, c {v) 
has a unique optimal solution that is also the optimal solution of IPc^(v) for all v G Z™ where 
Fc{y) 7^ ([16])- So, solving integer programs IPc,c{v) is essentially equivalent to solving lattice 
programs. 

4 Computing truncated Grobner bases 

In this section, we describe how to compute truncated Grobner bases. We first describe how to 
compute truncated Markov bases since the algorithm for computing truncated Grobner bases is 
used to compute truncated Markov bases. We present existing algorithms for truncated Grobner 
bases including a new approaches to truncation. The structure of this section follows closely from 
[12] except that we now deal with truncation, and so, we have omitted the proofs of those results 
in this section that correspond closely to results in [12]. 
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We now describe Grobner bases in terms of reduction paths, so that we avoid explicitly mentioning 
the ^-minimal solution of every fiber. A path (x°, . . . ,x k ) in Qc(v, G) is a >-- reduction path if 
for all i G {1, . . . , k — 1}, we have either x° y x l or x k y x % . For example, see Figure 3. 




Figure 3: Reduction path between x and y. 

Lemma 4.1. Given v G Z™ , a set G C is a y -Grobner basis of Tc(y) if and only if for each 
pair x,y G Tc(y), there exists a y -reduction path in Qc{v, G) between x and y. 

Checking for a given G C C y whether there exists a ^-reduction path in Gc(v, G) for every v G Z n 
and for each pair x, y G Fc{v) involves many situations that need to be checked. In fact, far fewer 
checks are needed: we only need to check for a y- reduction path from x to y if there exists a 
^-critical path from x to y. 

Definition 4.2. Given GC£^ and v G Z n , a path (x,z,y) in Gc(v,G) is a ^-critical path if 

z y x and z y y. 

If (x, z, y) is a ^-critical path in Gc(y, G), then x + u = z= y + viov some pair u,v G G, in which 
case, we call (x,z,y) a y- critical path for (u,v) (see Figure 4). 




Figure 4: A critical path for (u, v) between x, z, and y. 

Lemma 4.3. Given v G Z™, let G C where G is a Markov basis of Tc(y)- G is a y -Grobner 
basis of ' Tc(y) if and only if there exists a y -reduction path between x' and y' for every y -critical 
path (x',z',y') in Gc.{y,G). 

We can extend Lemma 4.3 to ^-truncated Grobner bases. It is a straight-forward consequence of 
Lemma 4.3, but nevertheless, it is worthwhile stating explicitly. 

Lemma 4.4. Given v G Z™, let G C C y where G is a v-truncated Markov basis of C G is a 
v-truncated y -Grobner basis of C if and only if there exists a y -reduction path between x' and y' 
for every y -critical path (x' , z',y') in Qc{v' G) for all v' G Bc{v). 

It is not necessary to check for a ^-reduction path from x' to y' for every ^-critical path (x' , y', z') 
in Qcty ,G) for all v' G Bc{v). Consider the case where there exists another ^-critical path 
(x", y", z") in Qc{v", G) for some v" G Z" such that (x', y', z') = (x" + 7, y" + 7, z" + 7) for some 
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7 G N™. Then, a y- reduction path from x" to y" in Gc{ v " ,G) translates by 7 to a >-- reduction 
path from x' to y' in Gc{v',G). Moreover, v" G Bc(v), since 7 G Tc(y' — v") ^ which implies 
that — f") ^ because — 1/) ^ 0. Thus, we only need to check for a ^-reduction path 

from x" to y". 

We call a ^-critical path (x, y, z) minimal if there does not exist another ^-critical path (x', y', z') 
such that (x,y, z) = (x' + 7, y' + 7, z' + 7) for some 7 G N" where 7 ^ 0, or equivalently, 
minjxi, j/i, Zi} = for all i = 1, . . . , n. Consequently, if there exists a ^-reduction path between 
x' and y' for all minimal ^-critical paths (x',y',z') in Gc{v'tG) for some 1/ G Bc{v), then there 
exists a ^-reduction path between x" and y" for all ^-critical paths (x" ,y" , z") in Gc(v",G) for 
some 1/' G Bc(v). Also, for each pair of vectors u,v G G, there exists a unique minimal ^-critical 
path [x^ u ' v \ z^ u,v \ yf"'")) in Gc{v^ u ' v \G) determined by z^'") := max{u + ,w + } component- wise, 
x («,t>) := z (u,v) _ Uj yCu.t;) := z {u,v) _ Vj and v (u,v) := g 0j any other ^_ cr iti ca l path for 

is of the form (x^"'") +7, z^ u,v ^ + r y,y^ u,v ^ +7) for some 7 G N™. Using minimal ^-critical paths, we 
can rewrite Lemma 4.4, so that we only need to check for a finite number of ^-reduction paths. 

Lemma 4.5. Let G C £^ and i> G IP. T/ie set G is a v-truncated y-Grobner basis of £ if and 
only if for all u,v G G where i/"'") G Bciy), there exists a >- -reduction path between x^ u,v ^ and 
y( u ^ in Gc{v {u ' v \G). 

We now turn Lemma 4.5 into an algorithmic tool. Algorithm 2 below, called a completion procedure 
([4]), starts from a i^-truncated Markov basis and computes a ^-truncated ^-Grobner basis. An 
important part of this algorithm is checking whether v 1 G Bciy) for some v' G IP. How exactly we 
perform this check in practice is discussed at length after first presenting the overall algorithm. 

Given a set S C £, the completion procedure first sets G :— S, and then directs all vectors in G 
according to >- such that G C £ y . It also removes from the set G any vectors u G G such that 
u + £ Bc(y) - recall that these vectors are not needed in a truncated Markov basis. Note that 
at this point Gc{ v ' ' , S) = Gc{v\G) for all v' G Bc{v) 1 and thus, G is also a ^-truncated Markov 
basis of £. The completion procedure then determines whether the set G satisfies Lemma 4.5; in 
other words, it tries to find a reduction path from x^ u,v ^ to y( u * v ) for every pair u,v G G where 
v (u,v) g Bciy). If G satisfies Lemma 4.5, then we are done. Otherwise, no ^-reduction path was 
found for some (u,v), in which case, we add a vector to G so that a ^-reduction path exists, and 
then again, test whether G satisfies Lemma 4.5 and so on. 

To check for a ^-reduction path from x^ u ' v ^ to y( u ' v \ we construct a maximal ^-decreasing path in 
G c (v {u ' v) ,G) from 

x (u,v) to somc x > and from y( u ' v "> to some y' using the "Normal Form Algorithm" 
(Algorithm 1 below). If x' = y' , then we have found a ^-reduction path from x^ u ' v ^ to y( u ' v \ 
Otherwise, we add the vector r G £y to G where r :— x' — y' if x' >~ y', and r := y' — x' otherwise, 
and then, there is now a ^-reduction path from x (u ^ to y( u > v ) in Gc{v^ u,v \G). 

Algorithm 1 Normal Form Algorithm 
Input: a vector x G N™ and a set G C £ y . 

Output: a vector x' where there is a maximal ^-decreasing path from x to x' in Gc( x , G). 
x' := x 

while there is exists aeG such that u + < x' do 

x 1 := x' — u 
end while 
return x' 
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Algorithm 2 Truncated completion procedure 

Input: a vector v G Z™, a term ordering and a ^-truncated Markov basis S C £. 
Output: a ^-truncated Grobner basis G C £>_. 
G := {w : u+ >- G 5} U {-u : w~ >- m + , u G 5} 

G := {u : u G G, w+ G B/^i/)} 
G := {(«, v) : u, w G G, G #c(i/)} 

while G 7^ do 
Select (u, u) G G 
G:=G\ {(«,«)} 

r := NTix^ , G) - MT{y^ , G) 
if r 7^ then 

if r~ >~ r + then r := — r 
G := G U {(r, s) : s G G, i/( r >») G B c (v)} 
G :=GU{r} 
end if 
end while 
return G. 



We write Aff(x, G) for the output of the Normal Form Algorithm and we write CV V {>~, S) for the 
output of the Completion Procedure. 

There is a trade off between the computational benefit of computing a ^-truncated Markov basis 
(computing a smaller set) and the computational cost of computing whether v' G Bc{v) for some 
v' G Z™ many times. In general, it is NP-hard to determine whether v' G t$c{ u ) since we must 
know if J-c{v') 7^ and Tc,{y — is') 7^ 0. Instead, we can check a sufficient condition for when 
v' Bc{v), and so, we compute a superset of a z/-truncated Grobner basis since we keep some 
vectors that are not needed. 

Firstly, note that in Algorithm 2, whenever we check whether v' G Bc{v) 1 we always have Tc(y r ) 7^ 
since either v 1 = u + > for some u G £ or v' = i/( u >' u ) > for some u,v G £ and in either case 
v 1 G Tciy') 7^ 0. So, in the algorithm, we only need to check whether Tc.(y — v') 7^ 0. 

We could instead check for feasibility of a relaxation of the feasible set Tciy — v'). One possible 
relaxation of Tc(y — v') to check is 

T^iy - v') := {x : x = v - v' (mod C),x G Z"}. 

But since v — v' G Z n , we have v — v' G T^{v — v') 7^ 0, and so, this is trivially always satisfied. 
Another possible relaxation is the linear relaxation of Tc{ v — 

-v')-~{x:x = v-v' (mod £ R ), x G R" } 

where £ R C R" is the smallest subspace containing £; that is, C R := {ku : u G £, k G R}. We can 
thus solve a linear program to check whether T^(y — u') = implying that Tc.(y — v') = 0. Note 
that Tciy - v') = T^(v - v 1 ) n T%{v - v'), but Tf(v - z/) ^ and ^|(i/ - v') ^ do not imply 
that F c [v - v ) + 0- 

In practice, computational experiments show that it is usually not worthwhile performing the full 
check whether T^{v — u') = 0, so instead, we use a sufficient condition for when T^{v — v') = 
and thus v' Bc{y) that is quick to check. Let 

C° + := {a G R" : au = Vw G £}. 
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Note that C° + is a pointed convex cone. Firstly, observe that, for any a G £1 and any v' G Z™, we 
have ax = av' for all x G Tc(y'\ Secondly, if a € L° +1 then, for all v 1 G Bc{v), we have > az/ 
since if a; G — v') ^ 0, then a(v — v') = ax and ax > because a > and x > 0. Therefore, 

if av < av' , then ^"(f — z/) = and thus z/ ^ Bc{v). Moreover, it follows from Farkas' lemma 
that J-^{v — v 1 ) = if and only if there exists an a G £^ where av < av' , and furthermore, 
— z/) = if and only if there exists an extreme ray a of the cone C° + where av < av' . The 
set of extreme rays is finite but there are far too many of them in general to check this condition. 
So, we need a way of selecting one a G C° + or a small set of a. Choosing different a's can produce 
very different results, and the best a's to choose vary from fiber to fiber. 

We now present a novel approach for selecting a good a G C° + . Now, note that when we run 
Algorithm 2 and check whether v' G Bc{v), we have av' > for all a G C° + since from above 
FtW) 7^ $ (v' > 0). Ideally, there exists a G C° + where av = 0, implying that av' = (i.e. if 
a-i ^ 0, then v[ = 0) for every v' G Bciy). This condition is very strong and is quick to check and 
effectively means that we compute using a sub-lattice of C. Otherwise if av > for all a G C° + , 
then a useful heuristic is to choose a single a G C° + such that av is minimal with respect to some 
norm || • || of a. More formally, we solve the following problem: 

argminjaz/ : | |a| | = 1, a G £+}• 

If we use the ^i-norm (i.e. ||a||i = X)i a i); then we can find a using linear programming. In this 
case, note that we only need to solve one linear program to compute a as opposed to solving a 
linear program every time we check whether v' G Bc{v). 

Example 4.6. Consider again the set S :={(1,-1,-1,-3,1,2), (1,0, 2,-2,-1,1)} and the lattice C C Z 6 
spanned by S. Let c := (2, 1,0,0,0,0) and let -< be some term order. Then, a -< C -Grdbner basis of 
£ is 

G := {(1,-1,-1,-3,1,2), (1,0,2,-2,-1,1), (1,1,5,-1,-3,0), (0,1,3,1,-2,-1), (2,-1,1,-5,0,3)}. 

Recall that this is a < C -Grdbner basis for every possible fiber v G Z™. We now examine truncated 
< C -Grdbner basis for two different fibers. 

(i). Consider v:= (0,1,0,5,0,0) (see Figure 2b); T c {v) = {(2, 0, 1, 0, 0, 3), (0, 1, 0, 5, 0, 0)}. Since 
the feasible set consists of only two feasible solutions, the minimal v-truncated < C -Grdbner 
basis contains only one vector: the vector between the two feasible solutions. Thus, the set 
{(2,-1,1,-5,0,3)} is a v-truncated < C -Grdbner basis of L. 

If we run the truncated completion procedure, Algorithm 2, using J-^(v — v') ^ as a check 
for truncation, we compute the set CV U (>~, S) = {(2,-1,1,-5,0,3)}. 

// instead we run the truncated completion procedure using the quick truncation test av < av' 
where a := 4(0,1,1,0,2,0) = argmin{av : \\a\\i — l,a G £+}, we again compute the set 
CV V {>, S) = {(2,-1,1,-5,0,3)}. Note that av = ±(0, 1, 1, 0, 2, 0) • (0, 1, 0, 5, 0, 0) = \. Then, for 
example, av' = ^(0,1,1,0,2,0)- (1,-1,-1, -3, 1,2) + = 5 > av; hence, the vector (1,-1,-1,-3,1,2) 
is not needed in a v-truncated < C -Grdbner basis of C. 

On the other hand, if we used the vector a :— ^(0, 0, 1, 5, 0, 8) G C° + , then the quick truncation 
check av < av' is useless, and we would compute all five vectors of the < C -Grdbner basis of 
C. 
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(it). Consider v := (2,2,4,2,0,0) (see Figure 2a); Tciy) = {(2, 1, 1, 1, 2, 1), (2, 2, 4, 2, 0, 0)}. Since, 
the feasible set consists of only two feasible solutions, the set {(0,1,3,1,-2,-1)} is a v-truncated 
< C -Grdbner basis of C. 

Using T^(v — v') ^ as a check for truncation, we compute the following v-truncated < c - 
Grobner basis of C: G := {(0,1, 3, 1,-2,-1), (1,0, 2,-2, -1,1)}. So, we have computed an additional 
vector (1,0,2,-2,-1,1) that is not strictly needed since Tciy — v') = even though T^(v — v') ^ 
where v' := (1,0,2,-2,-1,1)+ = (1,0,2,0,0,1). 

Using the vector a :~ j(0, 1, 0, 1, 0, 2) = argmin{av : \\a\\i = 1, a G £+} as a quick check for 
truncation, we obtain the following v-truncated < C -Grdbner basis of C: 

G := {(1,-1,-1,-3,1,2), (1,0,2,-2,-1,1), (1,1,5,-1,-3,0), (0,1,3,1,-2,-1)}. 

So here, we have computed three additional unnecessary vectors. If instead we use the vector 
^(0,0,1,5,0,8), then we would have computed only three vectors. In this case, there is no 
single vector in a G C° + that results in only two vectors being computed. 

The following example demonstrates the potential speed increase from computing a truncated 
Grobner basis as opposed to computing a full Grobner basis. We use three different methods for 
checking whether v' G Bc{v) in order of increasing effectiveness: 

(i) . av < av 1 where a = argmin{a^ : ||a||i = l,a G £+}, 

(ii) . ^(v-v') = <D, or 

(iii) . f c {v-v')=$. 

Since criterion (i) is in general much faster to check than (ii), we always check (i) before (ii), and 
similarly, since criterion (i) and (ii) are in general much faster to check than (iii), we always check 
them both before applying criterion (iii). We solve T^(y — v') = using the simplex algorithm 
implementation in the GLPK (GNU Linear Programming Kit) package. 1 We solve J~c(v — v') = 
using the branch-and-bound implementation in GLPK, which is not useful in practice, but we use 
it here to show the sizes of minimal truncated Markov bases. 

Example 4.7. Let C = C A ■= {u : Au = 0, u G Z n } where 

" 15 4 14 19 2 1 10 17 11 9 4 15 20 " 

18 11 13 5 16 16 8 19 18 21 5 7 1 

11 7 8 19 15 18 14 6 1 23 11 3 10 

17 10 13 17 16 14 15 18 3 2 1 17 1 

The size of a minimal Markov basis of C is 10868. Let c = (3, 15, 1, 5, 2, 17, 16, 16, 15, 9, 7, 11, 13). 
The size of a minimal < C -Grdbner basis of C for some term order -< is 24941. This takes 106.96 
seconds to compute using 4ti2. In the following table, we list the time taken to compute truncated 
Grobner bases from the minimal Markov basis of C. The first column lists the values used for v. In 
the following columns, we list the size of the computed set and the time taken for each of the three 
possible ways to check whether v' G Bc{v). 

X GLPK is open source and freely available from http://www.gnu.org/software/glpk/ 
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V 






Tc(v-v") 


(1,1,1,0,1,0,1,1,0,1,0,1,0) 


307 


0.02s 


i 


0.09s 





0.10s 


(1,0,1,0,3,0,1,5,0,1,0,9,0) 


418 


0.10s 


36 


0.19s 





0.31s 


(1,1,1,1,1,1,1,1,1,1,1,1,1) 


6494 


1.61s 


201 


1.20s 





2.18s 


(1,2,0,3,5,0,1,3,0,4,0,1,0) 


12191 


6.31s 


5028 


4.43s 


158 


186.81s 


(19,7,3,8,13,11,1,15,4,8,17,9,5) 


24748 


108.19s 


24334 


107.25s 


24284 


> 3600s 



For the example above, choosing a single a G C° + where a := argminja^ : ||o||i = 1, a G C° + } 
works reasonably well when used for checking for truncation. However, in general, using more than 
one such a may be significantly better particularly when the support of a (the set of non-zero 
components) is small. 

Observe that to compute a truncated Grobner bases in the previous example, we first needed to 
compute a Markov basis, and in some cases, computing the Markov basis took significantly longer 
than computing the truncated Grobner basis. This provides motivation for the next section in 
which we compute truncated Markov basis. 

5 Computing truncated Markov bases 

In this section, we give a Project-and-Lift algorithm for computing truncated Markov bases. 

Given a C {1, . . . , n), wc define the projective map 7r CT : Z™ i— ► Zl" 7 that projects a vector in Z™ 
onto the a components. We define Cf where a C {1, . . . ,n} as the projection of C onto the o 
components - that is, Cf = n a (C). Note that L a is also a lattice. For ease of notation, we will 
often denote the singleton set {i} as just i, and so, for example, is denoted D and n^y is 
denoted 7Tj. It should be clear from the context whether by i we mean {i} or just i. 

The fundamental idea behind the Project-and-Lift algorithm is that, for some v G Z™, using a set 
S C C 1 that is a 7Ti(z/)-truncated Markov basis of C 1 for some i G {1, . . . ,n}, we can compute a 
set S' C C 1 such that S' lifts to a ^-truncated Markov basis of C. So, for some a C {1, . . . , n}, 
since Cf is also a lattice, starting with a ^-truncated Markov basis of £ a , we can compute a 
7r <r\i(^)-truncated Markov basis of £ a \ l for some i G a. By doing this repeatedly for every i G a, 
we attain a ^-truncated Markov basis of C. 

First, we extend the definition of reduction paths and ^-truncated Grobner bases. Given some 
vector c G Q™, a path . . . , x k ) in Gc{v, G) is an c-reduction path if for all j G {1, . . . , k — 1}, we 
have either cx° > cx^ or cx k > cxK A set G C C is a c-Grobner basis of Tciy) if for every pair 
a;, y G Tc(y), there exists a c-reduction path from x to y in Gc(y, G). A set G C £ is a ^-truncated 
c-Grobner basis of £ if for all j/ G Bc{v), G is a c-Grobner basis of Tc(y'}. 

The following lemma is fundamental to the Project-and-Lift algorithm. Note that the property 
that ker(7Ti) n C = {0} for some i G {1, . . . , n} means that the map iTi from C to C 1 is a bijection 
and thus, the inverse map 7r^ : C i— > £ is well-defined (each vector in lifts to a unique vector 
in £). Moreover, by linear algebra, for all u G £, there must exist a vector u l G Q" _1 such 
that io % ■ TTi(u) — Ui. We always write such a vector as uj % . Importantly, note that given v G Z™, 
we have ^i{Bc{v)) C B C i(^i(^)) since if ^' G Bc{v), then there exists 7 G — ^')> an( i so ' 

7Tj(7) G J r £i(7r i (^ - j/')) 7^ 0, and consequently, 7T;(i/) G ^£.(^(1/)). 

Lemma 5.1. Let i G {1, . . . ,n} where ker(7Ti) n C = {0}, and let S C £*. Let !v G Z™. If S is a 
71 i(v) -truncated {-uj 1 )- Grobner basis of C 1 , then tt'^S) is a v-truncated {-e 1 )- Grobner basis of C. 
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Proof. Assume S is a 7ri(^)-truncated (-a/)-Grobner basis of C l . Let x,y G Tciy') for some v' G 
Bc{v). We need to show that there is an (-e l )-reduction path from x to y in Qn{v' , n'^S)). Let 

x = ni(x), y — TTi(y), and v' = 7Tj(z/) G B C i{-Ki(v)). By assumption, there exists an (-a/) -reduction 
path (x — x°, . . . ,x k — y) in Q^iy' , 5 1 ). So, we have either ui % x^ > a/x or a/x 7 > a/y for all j. 
We now lift this (-o/)-reduction path in Gc 1 ^' \S) to an (-e l )-reduction path in Qc{v' 1 tt'^S)). Let 

xi = v' + ^(x 7 — v') for all j = 0, . . . , k. Hence, 7r,(a;- J ) = x 7 and a/x 7 = x^, and therefore, either 
x\ > Xi or x\ > yi. Also, x- 7 — a? 7 ' -1 = ^(x 7 — x J_1 ) G 7r^ ($) for all j = 1, . . . , k. Therefore, 
(x = x°, . . . , y k = y) is an (-e 1 production path in Qc{v, 7r^(5)) as required. □ 

The converse of Lemma 5.1 is not true: if irf-^S) is a ^-truncated (-e J )-Grobner basis of C, then 
5* is not necessarily a -^(i^-truncated (-u/)-Grobncr basis of C. If ^(fi^z/)) = Bc(ys), then the 
converse holds, since if ^(S) is a (-e*)-Grobner basis of Tc(y') for some t/ G Z™, then S is a 
(-o/)-Gr6bner basis of Tc{v') where v' = iri(v') because (-e*)-rcduction paths in Qc{v' , ^(S)) 
project to (-cy)-reduction paths in Gc{v\S). In general however, Ki{Bc{v)) C B£i(ni(v)), and we 
may have iri{Bc{v)) C B c , (^(z/)). 

By definition, an (-e*)-Grobner basis of £ is a Markov basis of C. Conversely, a Markov basis 
of C is also an (-e')-Grobner basis of C. This follows since, given a Markov basis of C, for any 
x, y G Tciy) for any v, there must exist a path from x — 7 to y — 7 where 7 = min{xi, y{\ ■ e\ and 
by translating such a path by 7, we get an (-e l )-reduction path from x to y. So, we arrive at the 
following corollary. 

Corollary 5.2. Leti G {1, ... ,71} where ker(7r i )(~l£ = {0}, and let S C £*. J/S* is a -Ki(v) -truncated 
(-uj t )-Grobner basis of C , then n} (S) is a v-truncated Markov basis of C. 

Given any vector c G Z" and a term order -< for C, recall that for the ordering -< c , we have 
x ^ c y if cx < cy or cx = cy and x -< y. Also, recall that the order -< c is a term order if and 
only if IPc yC (0) = 0. Importantly then, a -7-reduction path is also a c-reduction path. So, we can 
compute a ^-truncated c-Grobner basis by computing a ^-truncated ^ C -Gr6bner basis. 

If IPc- e i(0) '■— rnaxjxi : x G C, x G N™} = 0, we say that i is bounded for C and unbounded 
otherwise. Thus, -<_ e i is a term order for C if and only if i is bounded, and moreover, -<_ w i is a 
term order for /? if and only if i is bounded since 

lp c,-e*(0) = max{x 4 : x G £, x G N"} = max{w l x : x G £\x G N"" 1 } = IP^ r ^(0). 

Now if i is bounded, then the ordering -<_ w i is a term order for C l , and so, given a set S* G C 1 that 
is a ^-truncated Markov basis of C\ we can compute a ^-truncated (-u/)-Grobner basis of C using 
Algorithm 2. In other words, the set S' = C7' 7ri (, y )(^_ w i, S) is a 7^ (^-truncated (-w l )-Gr6bner basis 
of D , and by Corollary 5.2, the set w'^S') is a ^-truncated Markov basis of C. 

If i is unbounded, then computing a ^-truncated Markov basis of C from a 71^ (^-truncated Markov 
basis of C l is actually more straight-forward than otherwise. Crucially, i is unbounded if and only if 
IPjr _ e i (0) > or equivalently there exists u G £nN™ where Ui > 0. Then assuming ker(7r i )n£ = 0, 
given a set S G C l that is a 7r i (^)-truncated Markov basis of £*, it suffices to add u to w'^S') to 
create a i^-truncated Markov basis of C (see Lemma 5.3 below). We can use linear programming 
to check whether i is unbounded and also to find such a u G C n N" where Ui > 0. 

Lemma 5.3. Let « G {1, . . . , n} and ker(7Ti) n C = 0, and u G C (~l N" w/iere u, > 0. If S C C l is a 
■Ki{v) -truncated Markov basis of C 1 , then ir'^S) U {u} is a v-truncated Markov basis of C 
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Proof. Let x',y' £ Fciy') for some v' £ Bc(v). Since S is a 7Ti(V)-truncated Markov basis of D , 
there exists a path from iTi(x') to 7Tj(y'). We can convert this path into a (-o/)-reduction path 
in Q C i{-Ki{v'),S U TTi(uj) by adding 7Tj(u) to the start of the path as many times as necessary 
and subtracting TTi(u) from the end of the path the same number of times. This works since 
uj l (iTi(u)) — Ui > and u > 0. As in Lemma 5.1, we can then lift this to a path from x' to y' in 

fcK,^(S)uW). □ 

We can apply the above reasoning to compute a Markov basis of £ CT \ J from a Markov basis of Z" 
for some a C {1, . . . , n} and i £ a. First, analogously to 7Tj and in the context of C l and £, 
we define 7rf and in the same way except in the context of C a and C 7 ^ respectively. 

We can now present our Project-and-Lift algorithm (Algorithm 3). 



Algorithm 3 Project-and-Lift algorithm 
Input: a lattice £ and a vector v £ Z™. 
Output: a ^-truncated Markov basis M of C 

Find a set a C {1, . . . , n} such that ker(7r CT ) n C = {0}. 
Compute a set M C £ CT that is a ^-truncated Markov basis of C a . 
while g ^ do 
Select « £ g 
if i is bounded then 
G M) 
M:= (O-HG) 
else 

Compute u G £ CT \' n N™ such that u; > 

M:= «)- 1 (M)uM 
end if 
a := a\i 

M :={u£M :u+ £ B c °{va)} 
end while 
return M . 



Lemma 5.4. Algorithm 3 terminates and satisfies its specifications. 

Proof. Algorithm 3 terminates, since Algorithm 2, which computes CV Vs > M)), always termi- 
nates. 

We claim that for each iteration of the algorithm, M is a ^-truncated Markov basis of C and 
ker(7r CT ) n C = {0}; therefore, at termination, M is a ^-truncated Markov basis of C. This is true 
for the first iteration, so we assume it is true for the current iteration. 

If a = 0, then there is nothing left to do, so assume otherwise. Since by assumption, ker(7r CT ) Pi£ a = 
{0}, we must have ker(7rf ) n£ CT ^ = {0}, and so, the inverse map (irf ) _1 : C a — > £ a \ l is well-defined. 
Let i £ g, and g' := er\i. If i is bounded, then let G :~ CV Vs (-<* i, M); then, G is a -^-Grobncr 
basis of C° ' . Let M' :— (nf )~ 1 (G), and then by Corollary 5.2, M' is a -K a * (^)-truncated Markov basis 
of C a ' . Otherwise, let M := (nf ) _1 (M) U {u} where u £ C 7 ^ nN™ such that m > 0, and by Lemma 
5.3, M' is a 7iv (^-truncated Markov basis of C a . Also, M" := {u £ M' : u+ £ B c ,< {ir a >(v))} 
must be a 7iv (^)-truncated Markov basis of C? . 
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Lastly, since a' C a, we must have ker(7iv) n £ = {0}. Thus, the claim is true for the next 
iteration. □ 



Initially in our Project-and-Lift algorithm, we need to find a set a C {1, . . . , n} such that ker(7r cr ) n 
C = {0}, and then, we need to compute a Markov basis for C a . This is actually quite straight- 
forward and can be done in polynomial time. Let Bbea basis for the lattice C (£ is spanned by the 
rows of the matrix B). Let k := rank(B). Any k linearly independent columns of B then suffice to 
give a set a such that every vector in C a lifts to a unique vector in £; that is, ker(7r CT ) n C a = {0}. 
Such a set a can be found via Gaussian elimination. Let S = w (7 (B); then, S spans Cf , and 
S E i, kxk since |<r| = k. Let S' be an upper triangle matrix with positive diagonal entries and 
non-positive entries elsewhere such that (the rows of) S' span C a . We can always construct such 
a matrix S' from S in polynomial time using the Hermite Normal Form (HNF) algorithm (see 
for example [14]). Also, S' is a Markov basis of C since it is actually a Grobner basis of C with 
respect to a lexicographic ordering, and thus, a Markov basis of C a . 

Example 5.5. Consider again the set S :={(1, -1,-1, -3, 1,2), (1,0, 2,-2,-1,1)}, and the lattice C C Z 6 
spanned by S. Let again v := (0,1,0,5,0,0) (see Figure 2b). Recall that the minimal v-truncated 
< C -Grdbner basis is {(2,-1,1,-5,0,3)}, since T c (v) = {(2, 0, 1, 0, 0, 3), (0, 1, 0, 5, 0, 0)}. 

Let a = {3,4,5,6}. Then, ker( 7 r (T ) n C a = {0}. Note that tt ct (5) ={(1,-1), (1,0)}. The set M = 
{(1,0), (0,1)} is a Markov basis of L a . 

(i). Set i := 3. Then, i is unbounded since (1,0,2) e C a \ l . Thus, M = {(1, 0, 2), (0, 1, 3)} is a 
Markov basis of C a ^ . Set a = {4,5,6}. 

(ii). Set i := 5. Then, i is bounded. M ={(-2, 1,-1), (1,0, 2)} is a minimal (0,1,0) -truncated 

Grdbner basis of C a . Note that v s = (0,1,0). So, M ={(-2,1,-1,0), (1,0,2,-1)} is a (0,1,0,0)- 
truncated Markov basis of C a \ l . Set a = {4,6}. 

(Hi). Set i := 4. Then, i is bounded. M ={(2,-1,1,0)} is a minimal (0,1, 0,0) -truncated 

Grobner basis of C a . So, M ={(2,-1,1,-5,0)} is a (0,1, 0,5,0) -truncated Markov basis of 
£<A\ Set a = {6}. 

(iv). Set i := 6. Then, i is bounded. M ={(-2,1,-1,5,0)} is a minimal (0, 1,0, 5,0) -truncated -<_ w i- 
Grobner basis of C a . So, M ={(-2,1,-1,5,0,-3)} is a (0,1, 0,5, 0,0) -truncated Markov basis of 
C. 

In the above Markov basis computation, the size of the set M was never larger than 2 although the 
size of a full minimal Markov basis is 5. 

In the next example, we show the computational benefits of computing a truncated Markov basis 
as opposed to the full Markov basis. 

Example 5.6. Let C = Ca for the matrix A given in Example 4-7. The size of a minimal Markov 
basis of £ is 10868. It takes 36.39 seconds to compute. 

Let v = (1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1). The size of a minimal v-truncated Markov basis of C is 0. In 
the next table, we list the times taken to compute a v-truncated Markov basis using the three different 
criteria for truncation. We also list the sizes of the intermediate Grobner basis computations. The 
number at the top of the column is the size of a as used in algorithm 3. The first row is the case 
without using truncation. Note how the intermediate sizes of the truncated computations remain 
much smaller than the final size of a full Markov basis of C. 
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Truncation 


4 


3 


2 


1 





Time 


none 


545 


1822 


3681 


12573 


10868 


36.39s 


aeC° + 


545 


977 


1302 


1846 


564 


1.20s 


- v") 


545 


977 


878 


697 


194 


2.16s 


Tciy-y") 


545 


6 


3 


4 





20.73s 



In the following table, we list the times taken to compute a minimal truncated Markov basis for 
different v. The first column lists the values used for v. In the next columns, we list the size of the 
computed set and the time taken for each of the three possible ways to check whether v' £ Bc(y). 



V 


a£C° + 


F£{y - v") 




(1,1,1,0,1,0,1,1,0,1,0,1,0) 


4 


0.76s 


1 


0.90s 





3.33s 


(1,0,1,0,3,0,1,5,0,1,0,9,0) 


158 


16.70s 


36 


21.28s 





> 3600s 


(1,1,1,1,1,1,1,1,1,1,1,1,1) 


546 


1.20s 


194 


2.16s 





20.73s 


(1,2,0,3,5,0,1,3,0,4,0,1,0) 


7381 


7.61s 


3734 


11.47s 


146 


> 3600s 


(19,7,3,8,13,11,1,15,4,8,17,9,5) 


10814 


39.04s 


10761 


44.07s 


10739 


> 3600s 



Not only have we reduced the time to compute a Markov basis, we also have reduced the time to 
compute a truncated Grobner basis by using a truncated Markov basis instead of a full Markov 
basis. The following table lists the times for computing a truncated Grobner basis from a truncated 
Markov basis using the same cost vector c = (3, 15, 1, 5, 2, 17, 16, 16, 15, 9, 7, 11, 13) as before. 



V 


a£C° + 


Tl{v - v") 




(1,1,1,0,1,0,1,1,0,1,0,1,0) 


4 


0.00s 


1 


0.00s 





0.00s 


(1,0,1,0,3,0,1,5,0,1,0,9,0) 


167 


0.00s 


36 


0.19s 





0.00s 


(1,1,1,1,1,1,1,1,1,1,1,1,1) 


844 


0.05s 


201 


0.11s 





0.00s 


(1,2,0,3,5,0,1,3,0,4,0,1,0) 


11768 


5.92s 


5028 


4.07s 


158 


5.98s 


(19,7,3,8,13,11,1,15,4,8,17,9,5) 


24729 


109.57 


24334 


107.18s 


24284 


> 3600s 



Observe that in the previous example, the size of a truncated Markov basis for the fiber where 
v = (1, 0, 1, 0, 3, 0, 1, 5, 0, 1, 0, 9, 0) was very small, but it took much longer to compute than a much 
larger truncated Markov basis of other fibers. This anomaly can be attributed to the order in which 
the variables are chosen during the project-and-lift algorithm. If we reorder the variables so that the 
zero components in v = (1, 0, 1, 0, 3, 0, 1, 5, 0, 1, 0, 9, 0) are chosen first, then the algorithm computes 
a truncated Markov basis much faster. Hence, the efficiency of the algorithm is sensitive to the 
order in which the variables are chosen; therefore, future experimentation is needed to determine 
a heuristic for choosing a good variable ordering. 

6 Feasibility 

The project-and-lift algorithm can be used to find a feasible solution of Tc{v) for any i/£Z". 
Alternatively, in the truncated case, given a particular v, the project-and-lift algorithm can be used 
to find a feasible solution of Tc(y) and also a feasible solution of Fc{v') for any v' £ Bc(y). Thus, 
at the same time as finding a Markov basis, the algorithm can also compute a feasible solution. 

The basic idea is that, given some v £ Z™ and a feasible solution of T C i{TTi{v)) for some i £ 
{1, . . . , n} where ker^) n C — {0}, we can construct a feasible solution of Tc(y) if such a feasible 
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solution exists. Hence, for some a C {1, . ..,n}, starting with a feasible solution of Tciys) (we 
choose cr such that this feasible solution is easy to find), we can compute a feasible solution of 
^^'(M'M) f° r somc * G ct. By doing this repeatedly for every % G cr, we attain a feasible 
solution of Tc{v). 

We now show how to construct a feasible solution of Tciy) from a feasible solution of ^F^i^ii^)) 
for some i G {1, ...,n} where ker(7Ti) fl C = {0}. Let v G Z™, and a; G Fci(iTi(v)). First, we lift a;. 
Let x' := tt'^x — 7r,(i/)) + v. Note that (a; — ^i{v)) G /? and so 7T- 1 is well-defined. Now, we have 
TTi(x') = x and so x'j > for all j ^ i. Also, x' G T^fy). If a:^ > 0, then a;' G Tciy) an d we are done. 
So, assume < 0. Now, if i is unbounded, then there exists u G C n N™ where > 0; therefore, 
a;' + Au for some A G N is non-negative on the ith component and thus a feasible solution of Tciy). 
If i is bounded, then we can compute a set G that is a 7T, (V)-truncated -<_ w i-Gr6bner basis of C l for 
some term order -<. Let x" = MTix, G). Hence, x" is the optimal solution of IPck-< { {^iiy)) an d 
so also an optimal solution of IPc i ,-oj i {'^i{ 1 '))- Thus conceptually, when computing NFfa, G), we 
are just maximising the zth component which will thus become non-negative if a feasible solution 
of Tc(y) exists. Therefore, from Lemma 6.1 below, either x' := n'^x" — ni(v)) + v is a feasible 
solution of Tc,{v) or Tc,{v) = 0. 

Lemma 6.1. Let i G {l,...,n} where i is bounded and ker^) n C = {0}. Let v G Z™, and 

let x G be a (V) -minimal solution of J 7 c i ( 7T i( 1 '))- Then, Tciy) ^ i/ and only if 

(nt{x-^{ V )) + v) eF c {v). 

Proof. Let x' = {^(x — iti(y)) + v). If x' G Tc{v), then Tc(y) ^ by definition. We now 
prove the converse. Assume Tc(y) ^ 0, and let x" G Tc{y). Then, Wi(x") G Fc i {'Ki{ v )) an d so 
-u l TTi(x") > -lo % x which implies that x" < (n' i 1 (x"))i. Therefore, ir'^x") is non-negative and a 
feasible solution of Tc{v). □ 

To compute a feasible solution of Tc(y), we need to start from a feasible solution of Tciy^) for 
some a C {1, n) where ker(7r cr ) DC = {0}. As before in Section 5, we can find a set a C {1, .., n) 
such that ker(7r (J ) fl £ a = {0}. Moreover, we can also find a set S C £ CT such that 5 spans C a , 
and 5 is an upper triangle square matrix with positive diagonal entries and non-positive entries 
elsewhere. Now, the vector v s is a solution to the relaxation T\ a {y^) (non-negativity constraints 
are removed). Then, we can add appropriate non-negative multiples of the vectors in S to v s such 
that it becomes non- negative, and thus, we arrive at a feasible solution of Tc{ v &)- 

See Algorithm 4 for a description of the feasibility algorithm. 

Finally, note that each individual step needed to compute a feasible solution of Tc(y) is performed 
during the project-and-lift algorithm 3. So, at the same time as computing a Markov basis, we can 
compute a feasible solution. Moreover, we can compute feasible solutions for many different fibers 
simultaneously, and thus, we can avoid repeating the same Grobner basis computations for each 
fiber. 

Example 6.2. We apply the above method to find a feasible solution of equality constrained integer 
knapsack problems (see [2]): 

T = {x : Ax = b, x G N"} 

where A G N lx ™ and b G N. Let C = C A ■= {u : An = 0,u G Z™}. Then T = T c {v) where 
v G {x : Ax = b,x G Z n }. Finding such a vector v can be done in polynomial time using the HNF 
algorithm. If no such v exists, then the original problem T is infeasible. Computing a Markov basis 
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Algorithm 4 Feasibility algorithm 
Input: a lattice C and a vector v 6Z". 
Output: a feasible solution x G Tc(y) or infcasible. 
Find a set a C {1, . . . , n} such that ker(7r CT ) Pi £ = {0}. 
Compute a set M C £ CT that is a ^-truncated Markov basis of C . 
Compute a feasible solution x G -T 7 ^ (z'cr). 
while a ^ do 
Select « G a 
if i is bounded then 
G:=CP„,« ui ,M) 
M:= (O-^G) 
x A/>"(x, G) 
x := (7rf)- 1 (x-^) + 7r (TV (^) 
if Xi < then return infeasible 
else 

Compute u G n N" such that > 
M:= «)- 1 (M)U{u} 

x := x + Am where A G N such that (x + Au)i > 
end if 
a := a \ i 

M :={uGM :u+ G B c <r(v„)} 
end while 
return x. 



and i/iws solving the feasibility problem of any such knapsack problem involves only one Grobner 
basis computation. 2 

Consider the following knapsack feasibility problem: 

T := {x : 12223xi + 12224x 2 + 36674x 3 + 61119x 4 + 85569x 5 = 89643481 : x G N 5 }. 
Let C = C A where A = [12223 12224 36674 61119 85569] . Then, the set 

S={(12224,-12223,0,0,0),(2,-5,1,0,0),(-1,-4,0,1,0),(1,-8,0,0,1)} 

spans C. Let v = (-4889,12222,0,0,0), then T c (y) = T. Let a = {1}. Then, kcr(n a ) n C = {0}, 
and also, we have v s = x = (12222,0,0,0) G Tc<*(y s ). A Markov basis of C is 

S' = {(1,0,0,-1528), (0,1,0,-7640), (0,0,1,-6112), (0,0,0,12223)} . 

Recall that u l G Q™ _1 such that u) l u — (^(u))^. A -<_ u i -Grobner basis of C a is 

G = {(3,2444,0,0), (-2,2445,0,0),(5,-l,0,0), (-4,0,1,0), (-3,-1,0,1)} . 

The normal form of x is MT{x,G) = x' = (2,2444,0,0). We then lift this back into the original 
space, x" = (x' — u s ) + v = (—1,2,2444,0,0). This is not a feasible solution, and the problem is 
therefore infeasible. 

2 This Grobner basis method for computing a feasible solution for the special case of equality constrained integer 
knapsack problems was found independently by Bjarke H. Rounc ([15]). 
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We list the times to solve the feasibility problem in Figure 5. In each case, the problem was in- 
feasible. The right hand sides used for each knapsack is the Frobenius number, that is, the largest 
infeasible right hand side. 



Problem 


Equality constraint (A) 


RHS 0) 


Time 


cuwwl 


12223 12224 36674 61119 85569 


89643481 


0.00s 


cuww2 


12228 36679 36682 48908 61139 73365 


89716838 


0.00s 


cuww3 


12137 24269 36405 36407 48545 60683 


58925134 


0.00s 


cuww4 


13211 13212 39638 52844 66060 79268 92482 


104723595 


0.00s 


cuww5 


13429 26850 26855 40280 40281 53711 53714 67141 


45094583 


0.00s 


probl 


25067 49300 49717 62124 87608 88025 113673 119169 


3367335 


0.00s 


prob2 


11948 23330 30635 44197 92754 123389 136951 140745 


14215206 


0.00s 


prob3 


39559 61679 79625 99658 133404 137071 159757 173977 


58424799 


0.02s 


prob4 


48709 55893 62177 65919 86271 87692 102881 109765 


60575665 


0.01s 


prob5 


28637 48198 80330 91980 102221 135518 165564 176049 


62442884 


0.01s 


prob6 


20601 40429 42407 45415 53725 61919 64470 69340 78539 95043 


22382774 


0.30s 


prob7 


18902 26720 34538 34868 49201 49531 65167 66800 84069 137179 


27267751 


0.00s 


prob8 


17035 45529 48317 48506 86120 100178 112464 115819 125128 129688 


21733990 


0.01s 


prob9 


13719 20289 29067 60517 64354 65633 76969 102024 106036 199930 


13385099 


0.01s 


problO 


45276 70778 86911 92634 97839 125941 134269 141033 147279 153525 


106925261 


0.05s 


probl 1 


11615 27638 32124 48384 53542 56230 73104 73884 112951 130204 


577134 


0.48s 


probl2 


14770 32480 75923 86053 85747 91772 101240 115403 137390 147371 


944183 


0.32s 


probl 3 


15167 28569 36170 55419 70945 74926 95821 109046 121581 137695 


6765260 


0.78s 


probl4 


11828 14253 46209 52042 55987 72649 119704 129334 135589 138360 


80230 


0.23s 


probl 5 


13128 37469 39391 41928 53433 59283 81669 95339 110593 131989 


1663281 


0.17s 


probl 6 


35113 36869 46647 53560 81518 85287 102780 115459 146791 147097 


109710 


0.75s 


probl 7 


14054 22184 29952 64696 92752 97364 118723 119355 122370 140050 


752109 


0.22s 


probl 8 


20303 26239 33733 47223 55486 93776 119372 136158 136989 148851 


783879 


0.51s 


probl 9 


20212 30662 31420 49259 49701 62688 74254 77244 139477 142101 


677347 


0.29s 


prob20 


32663 41286 44549 45674 95772 111887 117611 117763 141840 149740 


1037608 


0.45s 



Figure 5: Hard Knapsack Constraint Instances. 



In the paper [2], the feasibility is solved problem for the same set of equality constrained integer 
knapsack problems by using a reduced lattice basis approach. The solutions times in [2] and our 
solutions times are all less than a second, and so it would be interesting to compare the two methods 
on larger problems with a significant computation time. 

This approach for computing a feasible solution of a fiber could potentially be used when computing 
a truncated Markov basis by the project and lift algorithm since during the algorithm, we check 
whether v' G Bc{v) which is the feasibility problem Tciy — v') ^ 0. Note that the feasibility 
approach is well-suited to computing feasibility for many different fibers simultaneously. It would 
be interesting to see the performance of this approach. 
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7 Optimality 



In this section, we discuss the use of Grobner bases to solve the integer program 

IPc,c{v) '■= minjca; : x G J~c{v)}- 

The most straight- forward way to solve IPc,c{ v ) is to compute a Markov basis of C and a feasible 
solution of Tc(y) and then compute a -< C -Gr6bner basis of C for some term order -<,, and finally, 
compute the normal form of the feasible solution giving the optimal solution. Here, we are actually 
solving IPc t ^ c (i') which is essentially the same as solving IPc,c{v)- With this method, if we want 
to solve IPc,c{v') for a finite number of u 1 , we only to compute a feasible solution of Tc(y) and 
redo the normal form computation without needing to recompute the Markov basis or the Grobner 
basis. Also, note that the feasible solutions can be computed at the same time as computing the 
Markov basis without much additional computational overhead (see Section 6). 

If we wish to solve IPc tC {v) for just one u, then we should use information specific to that fiber to 
solve the problem. We can compute a ^-truncated Markov basis C and a ^-truncated -< C -Gr6bncr 
basis of C. The problem with this method is that we must compute the entire ^-truncated 
Grobner basis in order to prove optimality. Moreover, if the feasible set Tc{y) is large, then the 
truncated Grobner basis may still be quite large and in some cases as large as the non-truncated 
Grobner basis. Thus, we need further ways of reducing its size. 

Some of the non-negativity constraints on the x variables may not strictly be necessary to solve 
the problem since they may be redundant or not active near the optimal solution. So, we consider 
relaxations of IPc,c{v) in which we relax the non-negativity constraints on some of the x variables. 
Consider the problem 

lp c.c{v) '■= min{c.T : x = v (mod £),x s >0,i£ Z™} 

where a C {1, n}. Here, we have relaxed the non- negativity constraints on x a . If c is the set of 
basic variables given by solving the linear relaxation of IPn c [y) using the simplex algorithm (see 
[14]), the relaxation IP£ c (y) is called a group relaxation (see [9]). Note that, for group relaxations, 
IP£ c {v) has an optimal solution and ker(7T (T ) DC — {0}. If a is any subset of the above set for the 
group relaxation, then IP^ c {y) is called an extended group relaxation (see [23]). Thus, the original 

problem IP C A V ) = lp c,c( v ) 

is an extended group relaxation. 

We want to solve these extended group relaxations using Grobner bases and so we must rewrite 
IP£ c {v) in the form IPc', c '{ v ') for some lattice £', some right hand side v', and some cost function 
c'. Firstly, any extended group relaxation IP^ c (v) that has an optimal solution can always be 
rewritten in the equivalent form IP^-(y) for some c where = 0, that is, c, = for alH £ a (as 
given by the simplex algorithm [14]) where IPc.ci 11 ) h as the same optimal solution as IP^ c (v), 
although the optimal value may differ by a known constant. Now consider the projection of IPc.ci 11 ) 
onto the a components: 

IPc,cA v ^) '■= min{5 ff a; : x = v s (mod £ a ),x £ N |ff| }. 

Any feasible solution of IPc ,c^{v s ) lifts to a feasible solution of IP^-iy). Let x £ Tciys)-, then 
x' := (x — ~k&{v)) + v e T a c iv). Moreover, an optimal solution of IPc fi s { v s) lifts to an optimal 
solution of IP^ £ (u) since c s x = cx'. Hence, IPc.ci 1 ')^ IP/z.ci 1 ') an d IPc ,c s {y&) are all essentially 
equivalent problems. 
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The basic idea of the algorithm is that we start with the group relaxation IPc ,c a {vg) where 
a is defined as above and we assume c s — without loss of generality. We then solve the group 
relaxation IPc,c 5 {v s ). If the optimal solution of IPc,c a lifts to a feasible solution of IPc,c{v), 
then it is optimal for IPc,c(v) and we are done. Otherwise, we add a non-negativity constraint 
on one of the unconstrained x variables, that is, we choose i £ a and set a := a \ i, and solve 
the extended group relaxation 1P^ Cs {y s ). Again if the optimal solution of IPc ,c„{vg) lifts to a 
feasible for IPc.c(v), then we are done. Otherwise, we again add a non- negativity constraint on 
one of the unconstrained x variables and solve the new extended group relaxation, and so on, until 
IPc,c{v) is solved. The algorithm must terminate with a solution because in the worst case we end 
up solving the original problem IPc,c{v) (cr = 0). 

To solve an extended group relaxation IP£«. Ci (fj), we first compute a ^-truncated Markov basis 
of C and a feasible solution of Tc{ v &)- Secondly, we compute a ^-truncated ^J^-Grobner basis 
of C . Then, we compute the normal form of the feasible solution giving the optimal solution of 

Initially, we need to compute a ^-truncated Markov basis of C for the group problem. Let B be 
a basis of the lattice C. Then for the group problem, a gives rank(B) linear independent columns 
of B. Thus, as discussed at the end of Section 5, we can compute a Markov basis via a HNF 
computation. Similarly, we can compute a feasible solution as discussed at the end of Section 6. 

At each iteration of the algorithm, we could compute a ^-truncated Markov basis of C starting 
from scratch each time as described in Section 5, but instead, we can compute it incrementally 
exactly as in the Project-and-Lift algorithm. In the previous iteration, we will have computed a 
^/-truncated Markov basis of C a where a' :— a U i for some i G S. Hence, using Lemmas 5.1 
and 5.3, we can compute a ^-truncated Markov basis of C? from a ^/-truncated Markov basis 
of C in one step. In effect, we perform the Project-and-Lift algorithm simultaneously. Also, as 
discussed in Section 6, we can compute a feasible solution of IPc c s (va) from a feasible solution 

See Algorithm 5 for a description of the optimisation algorithm. 



Algorithm 5 Optimisation algorithm 

Input: an integer program IPc, c (v). 

Output: an optimal solution x G Tc{y) or infeasible. 

Find a set a C {1, . . . , n} such that ker(7T CT ) PI £ = {0}. 

while a ^ do 

Compute a set M C L a that is a ^-truncated Markov basis of C a . 

Compute a feasible solution x e Tc{v s ) and return infeasible if Tciys) = 0- 

x := MT{x, G) 
x := n~J-(x - v s ) + v 
if x > then return x 
Select i 6 a. 
a := a\i 
end while 



At each iteration, we must select the next i. An obvious choice is to select the component with the 
most violated non-negativity constraint, that is, the most negative component. 
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Existing branch-and-bound methods for integer programming can take advantage of a good feasible 
solution of IPc, c {v), but the above method cannot. However, we can take advantage of a good 
feasible solution since a feasible solution gives us an upper bound on IPc,c(v) that can be used to 
strengthen truncation. 

Consider the following reformulation of IPc, c {v) using some upper bound k G 1 on IPc, c (v): 

IPcA v ) :=min{c:r : x = v (mod £),x G N™} 

= min{c.T : x = v (mod £), cx < k, x G N"} 

= min{— y : x = v (mod £),cx + y = k,x € N", y G N} + k. 

To solve the reformulation, we first need to express it in the form IPc,c'{ v ') for some lattice £ , 
right hand side v' and some cost function c'. Let £ := {(u, —cu) : u G £}, v' := (v, k — cv), and 
c' = (0,-1). Then, 

IPc.c'W) :=min{-y : (x,y) = {v,k - cv) (mod C'),(x,y) G 

= min{-y : (x - v,y - (k - cv)) G C, (x,y) G N" +1 } 

= min{— y : (x — v, y — (k — cv)) = (u, —cu),u G C, (x,y) G N™ +1 } 

= min{— y : x = v (mod £),cx + y = k,x € N™, y G N}. 

Thus, IPc,c(v) = IPc,c'{v') + k. So, we can solve IPc,c{ v ) by solving IPc, C '{v r ) using the methods 
discussed previously. 

Hopefully, a ^'-truncated ^; C '-Gr6bner basis of C is a lot smaller than a ^-truncated Grobner basis 
of C. Crucially, the size of a minimal ^'-truncated -< C '-Gr6bner basis of £ cannot exceed the size 
of a minimal ^-truncated ^ C -Gr6bner basis, and so, we are not computing more than before. This 
follows from Lemma 5.1; since 7r„+i(£') = £, 7r n +i(z/) = v, c' — -e" +1 , and c = -uj n+1 , if G is a 
i^-truncated ^; C -Gr6bner basis of £, then n^ +1 (G) is a (/-truncated ^ C '-Grobner basis of £ . How 
much smaller a ^'-truncated ^; C '-Gr6bner basis of £ is than a ^-truncated Grobner basis of C will 
depend on the strength of the upper bound. It is potentially just the empty set. 

If we are given a feasible solution x G Tc(y), then we can set k = cx — 1. If x is the optimal 
solution of IPc, c {v), then setting k = cx — 1, we have Tciy') = 0. Therefore, a minimal v'- 
truncated Markov basis of £ is empty and a minimal ^'-truncated ^; C /-Gr6bner basis of £ is also 
empty. So, potentially, computing a ^'-truncated ^ c /-Grobner basis of £ is a lot more efficient 
than computing a ^-truncated ^; C -Gr6bner basis of £ : we only have to compute an empty set to 
show optimality! 

Even if the bound k is not very good and thus does not help truncation much, it is still definitely 
worthwhile to solve IPc,c\ v ') instead of IPc,c{ v )- The reason is that by introducing the constraint 
cx < k into the problem, more components may become bounded and thus the Grobner basis and 
the Markov basis computations for IPc,c'(v') are faster (see the section in [12] on Criterion 2). 
The computations are also faster for the extended group relaxations of IPc'.c'(v') as well. 

Example 7.1. Let C = Ca for the matrix A given in Example 4-7. In the following table, we list 
the time taken to compute the optimal solution ofIPc, c (v) for different v's given a feasible solution 
where c = (3, 15, 1, 5, 2, 17, 16, 16, 15, 9, 7, 11, 13). 
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V 


Group Relaxation 


Final Relaxation 


Time 


(1,1,1,0,1,0,1,1,0,1,0,1,0) 


{3,4,5,10} 


{3,4,5,10} 


0.28s 


(1,0,1,0,3,0,1,5,0,1,0,9,0) 


{1,5,8,12} 


{1,5,8,12} 


0.02s 


(1,1,1,1,1,1,1,1,1,1,1,1,1) 


{3,4,5,10} 


{5,10} 


0.61s 


(1,2,0,3,5,0,1,3,0,4,0,1,0) 


{3,4,5,10} 


{3,5,10} 


0.46s 


(19,7,3,8,13,11,1,15,4,8,17,9,5) 


{3,4,5,10} 


{3,4,5,10} 


0.28s 



Here, we used the quick check for truncation. 

If we do not have a good feasible solution or any feasible solution at all available, we can still 
use the extended formulation. Assume that we are given a lower bound I on the optimal value, 
which we can always find by solving the linear relaxation. We then try to find a feasible solution 
by computing a ^'-truncated Markov basis of £ where k = I. If we find a feasible solution, then 
it must be optimal. Otherwise, we recompute a i^'-truncated Markov basis of £ where k = I + 1 
and again try to find a feasible solution. We repeat this procedure by incrementing k until we find 
a feasible solution which must be an optimal solution. This procedure has the advantage that we 
only compute feasible solutions and not optimal solutions, and thus, we avoid some Grobner basis 
computations. 

The recomputation of ^'-truncated Markov bases to find initial solutions initially seems inefficient; 
however, this is not the case because we can reuse the previous computations. Let v 1 = (f,k — cv) 
and v" = (v, k + 1 - cv). Then v' G B c {v") since (0, 1) G Tciy" - v') and so B c {v') C B c {v"). 
Hence, to compute a ^"-truncated Grobner basis or Markov basis of £ requires also computing a 
^'-truncated Grobner basis or Markov basis respectively anyway. This applies not only at the final 
stage of the algorithm for each value of k, but also at each intermediate stage for the extended 
group relaxations of IPc>, c >(v'). So, it requires keeping all the intermediate stages around, and is 
thus more complex than the first algorithm presented in this section. 

We have not implemented such an approach yet. It would be interesting to see how it performs. 
However, if we know a very good initial feasible solution, we would expect that the previous method 
is faster. 

8 Conclusion 

We have demonstrated that it is possible to significantly improve upon the performance of previous 
Grobner basis based approaches. However, Grobner basis approaches have not yet proven to be 
competitive with traditional branch-and-bound based approaches to integer programming for in- 
dustrial applications, but given the significant advances shown here, perhaps with further research, 
Grobner basis methods will be useful for some classes of problems when combined with existing 
methods. 

A Lattice Programs and Integer Programs 

In this appendix, we show the equivalence of fibers and feasible sets of integer programs and of 
lattice programs and integer programs. 
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Consider the set {x : Ax = b,x s > 0,x G Z™} where A G Z mx ", b G Z n , a C {l,...,n}, ct is 
the complement of a, and x ff is the set of variables indexed by a. Thus, the x s variables are non- 
negative and the x a variables (the x variables indexed by a) are unrestricted in sign. The set of 
feasible solutions for any integer program can be represented in this form. We will rewrite this set 
as a lattice fiber. We will actually only consider the projection of this set onto the non-negative 
variables (the a components), that is, F A (b) := {x s : Ax — b,x s > 0, x G Z"} since any solution of 
F%(b) can easily be extended to a solution in the original space; more specifically, given Xg G F%(b), 
we can find x a G Z^ where A a x a = b — AgXg by using the HNF algorithm where A a and A s are 
the sub-matrices of A whose columns are indexed by a and a respectively. 

We now write F A (b) as a fiber of a lattice. Let La = {u G Z" : Au = 0}, and let v G Z™ where 
Av = b. Note that we can compute a basis of La and a v using the HNF algorithm. Also, let L A be 
the lattice La projected onto the a components (i.e. L A := {u s : Au = 0}). Note that a projection 
of a lattice is always again a lattice. It follows that 

Fl(b) = {x s : Ax = b,x s > 0,x G Z™} 
= {xg- : Ax = Av, x s > 0, x G Z n } 
= {xg : A(x - v) = 0, x s > 0, x G Z"} 
= {xg : x — v G La, xg > 0, x G Z™} 

= {Xg : Xg - Vg G £^ , Xg > 0,Xg G Z'* 7 '} 

So, the set of feasible solutions to any integer program can be represented as a fiber of a lattice. 

Conversely, given a L and a v G Z", we can represent the fiber Tc(y) as the set of feasible solutions 
to an integer program. Let S G Z™ xfc be a matrix where the columns of 5 span the lattice L. Then, 

Tciy) = {x G N™ : x = v (mod £)} 
= {x G N" : x - v € £} 
= {ier :x-^ = S'y,yGZ fe } 
= {x : (I,-S)(x,y) = v,x>0,xeZ n ,ye Z fc }. 
= {x : A(x, y) = v,x>0,xeZ n ,yE Z fc }. 

where A = (I, -S) G jS n + k ) xn and cr = {1, ...,n} and = {n + 1, n + k}. Thus, fibers of lattices 
and feasible sets of integer programs are two different representations of the same set and so are 
equivalent concepts. 

Next we show the equivalence of lattice programs and integer programs. Any integer linear program 
can be written in the form min{cx : Ax = 6, x s > 0, x G Z™} where A G Z mxn , b G Z™, and c G Z". 
If this integer program has an optimal solution, then there exists a c G Z n where c a = such that 
cx = cx + k for some constant k G Q n and every feasible solution x. Then, 

minjcx : Ax = b, x s > 0, x G Z"} = minjca; + k : Ax = b, x s > 0, x G Z"} 

= min{cgXg : Ax = 6, x s > 0, x G Z"} + fc 
= min{cgXg : Xg G F^(6)} + fc 
= min{cgXg : Xg G Tc A (y^)\ + fc 



25 



where C a A and v s arc defined as above. More specifically, we can always find aceZ™ where c CT = 
such that cx = cx + k for every feasible solution x if and only if cx = for all ieZ" where x s = 
and Ax = 0. Note that if cx ^ for some i e Z" where x s = and Ar = 0, then the integer 
program has no optimal solution. We can check this condition and find a valid c easily using the 
HNF algorithm. 

Hence, any integer program with an optimal solution can be written in the form 

IPc,c(v) '■= minjea; : x £ Fc(v)} 

for some lattice £CZ", a vector v G Z™, and a vector ceZ". As we saw at the end of Section 3, 
solving IPc^ciy) is equivalent to solving the lattice program IPc^{v) where >- is compatible with 

c 
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